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^  Technological  advancements  have  led  to  increased  speed,  mobility, 
and  destructive  power  of  military  operations.  To  permit  commanders  to 
make  tactical  decisions  consistent  with  rapid  change  and  succession  of 
events,  it  is  essential  that  information  on  military  operations  be  pro¬ 
cessed  and  used  more  effectively  than  ever  before.  To  meet  this  need, 
the  Army  is  developing  automated  systems  for  receipt,  processing,  storage 
retrieval,  and  display  of  different  types  and  vast  amounts  of  military 
data.  The  automated  Army  Tactical  Operations  Center  (ARTOC)  is  a  proto¬ 
type  of  these  systems.  There  is  a  concomitant  requirement  for  research 
to  determine  how  human  abilities  can  be  utilized  to  enable  the  command 
information  processing  systems  to  function  with  maximum  effectiveness. 


PROCEDURE: 

The  first  step  was  a  survey  of  military  information  processing  equip¬ 
ment  and  systems  and  future  plans  in  this  area.  Basic  human  factors  prob¬ 
lems  were  identified  and  organized  around  five  critical  information  pro¬ 
cessing  systems  operations — screening  incoming  data,  transforming  raw 
data  for  input  into  storage  devices,  input,  assimilation  of  displayed  in¬ 
formation,  and  decision  making.  Studies  are  in  progress  which  will  yield 
empirical  information  on  specific  aspects  of  human  performance  in  the 
systems  with  regard  to  (l)  characteristics  of  the  information  processed, 
(2)  the  constantly  changing  nature  of  the  information,  and  (5)  display 
modes — sensory  modalities,  group  and  individual  displays,  and  (4)  per¬ 
formance  as  affected  by  certitude  and  credibility  of  the  information. 

Laboratory  simulation  is  used  in  the  experimentation,  and  plans  for 
computer  simulation  are  under  way.  Procedures  will,  where  feasible,  be 
tried  out  in  actual  systems  prior  to  recommendation  for  operational,  use. 
Finally,  some  effort  will  be  expended  in  keeping  abreast  of  innovations, 
new  developments ,  and  future  command  Information  processing  systems. 

The  purpose  is  to  avoid  the  obvious  shortcoming  of  being  bound  to  a  par¬ 
ticular  generation  of  systems,  to  maintain  responsiveness  to  new  needs 
through  a  flexible  research  program  oriented  toward  providing  findings 
with  broad  application. 


ACCOMPLISHMENTS  TO  DATE: 


A  broad,  program  of  research  has  been  formulated  and  several  prelimi¬ 
nary  studies  are  in  progress.  A  study  on  information  assimilation  from 
symbolic  displays  has  provided  information  on  the  effects  of  different 
degrees  in  updating  military  overlays.  Two  other  studies  are  in  final 
analysis — one  on  relationships  among  certitude,  display  characteristics, 
and  accuracy  of  information,  the  other  on  information  assimilation  from 
alpha-numeric  displays. 


OPERATIONAL  IMPLICATIONS: 

The  research  will  assist  users,  designers,  and  developers  of  current 
and  future  command  information  processing  systems  in  their  efforts  toward 
enhanced  systems  performance  by  providing  empirical  information  about 

1.  the  capabilities,  limitations,  and  reliability  of  human 
performance 

2.  allocation  of  functions  among  men  and  equipment 

3.  various  modes  and  sensory  modalities  of  presenting  Information 
for  assimilation  and  decision  making 

1*-.  effects  of  characteristics  of  the  information  displayed-- 
density,  type,  etc. 

5.  specification  of  effective  individual  and  group  work  methods  and 
techniques 

6.  procedures  for  identification  and  assignment  of  appropriate 
personnel  to  critical,  positions. 


MAN  IN  COMMAND  INFORMATION  PROCESSING  SYSTEMS— 
A  RESEARCH  PROGRAM 


Technological  developments  have  led  to  increased  adoption  of  newly 
developed  complex  systems  by  the  Army.  Witness  the  command  control  infor¬ 
mation  system,  conceived  as  a  network  of  cross-linked  highly  automated, 
computerized  systems,  each  dealing  with  specialized  functions,  and  all 
feeding  information  to  an  automated  tactical  operations  center.  The  Army 
Tactical  Operations  Center  (ARTOC)  is  a  prototype  of  such  a  system. 

The  U.  S.  Army  Personnel  Research  Office  has  developed  a  research 
program  designed  to  provide  human  factors  information  which  can  be  useful 
in  enhancing  the  output  of  these  developing  and  future  systems.  The 
present  research  study  describes  the  scope,  rationale,  and  organization 
of  the  planned  research  program. 


OBJECTIVES 

The  objectives  of  the  research  program  are  to  enhance  the  performance 
of  command  information  processing  systems  by  providing  users,  developers, 
and  designers  of  current  and  future  systems  with  information  concerning: 

1.  the  capabilities,  limitations,  and  reliability  of  human 
performance 

2.  allocation  of  functions  among  men  and  equipment 

3.  various  modes  and  sensory  modalities  of  presenting  information 
for  assimilation  and  decision  making 

4.  effects  of  characteristics  of  the  information  displayed — 
density,  type,  etc. 

5.  specification  of  effective  individual  and  group  work  methods 
and  techniques 

6.  procedures  for  identification  and  assignment  of  appropriate 
personnel  to  critical  positions. 

THE  ARTOC 


MAJOR  ACTIVITIES 


The  ARTOC  is  an  automated  facility  within  which  are  grouped  repre¬ 
sentatives  of  general  and  special  staff  sections  concerned  with  current 
tactical  and  tactical  support  operations.  These  representatives  assist 


the  commander  in  the  tactical  operations  aspects  of  his  exercise  of 
command  by  providing  current  information  on  the  tactical  support  available 
and  intelligence  estimates  of  enemy  actions,  by  making  recommendations 
for  command  decisions,  and  by  issuing  implementing  instructions.  Rapid 
coordination  among  operational  staff  elements  is  essential,  particularly 
in  viev  of  the  advent  of  nuclear  weapons  and  increased  capabilities  in 
electronic  warfare,  air  defense,  and  mobility. 

The  automated  TOC  is  designed  to  assist  the  staff  in  the  receipt, 
processing,  storage,  display,  and  transmittal  of  information  usually  re¬ 
presented  in  maps,  charts,  Journals,  and  work  sheets.  The  TOC  also  per¬ 
forms  certain  computations  on  call--target  analysis,  fallout  prediction, 
and  troop  movements — using  input,  storage,  computing,  display,  and  com¬ 
munication  devices.  Automation  enables  the  center  to  provide  information 
of  greater  scope,  depth,  and  currency  and  to  allow  more  time  for  consider¬ 
ation  and  use  of  this  information  in  decision  making.  Major  activities 
that  will  take  place  in  a  typical  ARTOC  are: 

1.  Continuous  and  simultaneous  evaluation  of  available  information 
by  TOC  elements  and  issuance  of  timely  instructions. 

2.  Communication  of  tactical  information  and  requirements  to  appro¬ 
priate  general  staff  sections  (particularly  Gl,  Gh,  and  G5),  and  trans¬ 
mission  of  instructions  to  tactical  units  and  tactical  support  units  or 
agencies. 


3-  Continuous  transmission  of  situation  information  by  each  element 
in  the  TOC  to  the  corresponding  element  in  an  alternate  TOC. 

4.  Continuous  display  and  evaluation  of  intelligence  required  for 
current  tactical  and  tactical  support  operations. 

5-  Continuous  display  of  data,  including  essential  administrative 
support  data,  on  the  status  and  operations  of  command  and  friendly  forces 
to  permit  immediate  decisions  on  tactical  and  tactical  support  operations. 


CRITICAL  MAN-MACHINE  FUNCTIONS 

The  ARTOC  will  receive  vast  amounts  of  information  from  many  and 
varied  sources.  The  information  varies  widely  in  content,  form,  and  de¬ 
gree  of  completeness.  Further,  the  information  often  affects  several  dif¬ 
ferent  staff  groups.  The  raw  data  require  a  great  deal  of  handling  and 
processing  by  man  or  by  man  and  equipment.  Personnel  will  work  under  a 
wide  variety  of  conditions  ranging  from  relatively  pressure-free  to  over¬ 
whelmingly  burdensome  situations.  Looking  at  the  system  as  a  whole,  there 
appear  to  be  five  critical  operations  that  man  and  equipment  have  to  per¬ 
form  (Figure  l) : 

1.  Screen  incoming  data  for  pertinence, 
priority,  and  routing. 


credibility,  impact, 
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Figure  2. 


2.  Transform  the  raw  data  to  proper  format  for  input  into  storage 
devices. 

3.  Input  the  transformed  data  into  storage  devices  for  subsequent 
computations  and  displays  (Figures  2,  3). 

4.  Assimilate  data  displayed  (Figure  4). 

5.  Decide  on  courses  of  action  based  on  information  displayed  and 
information  from  other  sources. 

Other  operations  that  must  be  performed — computer  programming, 
communication  of  decisions  for  implementation,  trouble  shooting  and 
maintenance  of  equipment — have  been  deliberately  excluded  from  the  USAPRO 
research  program  as  not  falling  within  the  relatively  homogeneous  domain 
of  real-time  processing  of  operational  tactical  information,  the  major 
focus  of  this  program. 


ROLE  OF  ARTOC  IN  THE  RESEARCH  PROGRAM 

In  planning  the  USAPRO  research  program,  the  ARTOC  is  treated  as  a 
point  of  departure,  a  prototype  of  command  information  processing  systems. 
In  these  systems,  there  is  heavy  dependence  on  various  computers,  input, 
and  output  devices — the  latter  capable  of  yielding  transient  projected 
images,  punched  tapes,  hard  copy  documents,  and  the  like.  With  respect 
to  the  different  kinds  of  information  that  must  be  processed  and  the 
number  of  different  operations  that  must  be  performed  by  man  and  equip¬ 
ment,  the  ARTOC  is  one  of  the  most  complex  systems  envisaged  by  the  Army. 
In  this  respect,  the  ARTOC  is  in  contrast  to  air  defense  and  fire  support 
systems,  which  are  more  specialized  in  function,  more  delimited  in  kinds 
of  information  to  be  processed.  Even  in  such  advanced  systems  as  ARTOC, 
some  of  the  critical  human  operations  discussed  (screen,  transform, 
input)  may  atrophy  or  disappear  in  the  wake  of  further  technological  de¬ 
velopments  and  later  generation  systems  which  will  permit  direct  input 
into  computers  through  data  links.  Human  factors  research  effort  and 
knowledge  gained  about  such  operations  will  not  be  wasted,  however,  since 
the  most  exotic  systems  are  not  likely  to  be  available  at  all  levels. 

Most  likely,  more  "primitive"  systems  will  be  used  at  some  levels  as  a 
backup  for  those  at  the  higher  levels.  Consequently,  the  ARTOC  is  viewed 
as  an  excellent  vehicle  for  generating  useful  research  findings  and 
approaches  that  will  generalize  across  many  automated  information  pro¬ 
cessing  systems. 


DELINEATING  THE  RESEARCH  PROBLEMS 

The  major  problems  in  command  information  processing  systems  emerge 
from  a  lack  of  experience  in  the  use  of  such  systems.  From  an  examination 
of  Army,  Navy,  and  Air  Force  reports  and  human  factors  research  literature, 


and  from  observation  of  equipment  and  subsystems  in  operation,  a  number 
of  basic  and  critical  questions  were  identified  which  need  to  be  answered 
before  such  systems  can  be  used  most  effectively. 

As  an  aid  in  formulating  specific  research  problems,  questions  re¬ 
quiring  attention  were  organized  in  terms  of  their  implications  for  the 
five  critical  human  information  processing  functions.  These  questions 
interact  within  each  functional  area  and  have  an  impact  on  other  areas 
as  well.  The  particular  grouping  of  questions  is  somewhat  arbitrary,  and 
other  patternings  may  emerge  after  additional  research  in  these  informa¬ 
tion  processing  systems. 

Since  the  entire  automated  information  processing  system  is  oriented 
toward  providing  information  to  the  commander  and  his  staff  to  assist 
them  in  the  critical  functions  of  information  assimilation  and  decision 
making,  current  task  activity  centers  about  problem  formulation  and  ex¬ 
ploratory  research  in  these  two  functions.  The  problems — and  research 
studies  designed  to  resolve  certain  of  these  problems--are  described  in 
some  detail.  The  questions  are  stated  from  the  point  of  view  of  optimi¬ 
zing  accuracy,  appropriateness,  and  speed  of  performance  of  the  two 
functions.  Questions  clustering  about  the  screening,  input,  and  trans¬ 
formation  of  information  are  the  subject  of  a  more  general  discussion  in 
which  the  nature  of  the  research  approach  is  indicated. 


CHARACTERISTICS  OF  INFORMATION  DISPLAYED 

In  the  areas  of  decision  making  and  information  assimilation  from 
displays  of  various  kinds,  a  number  of  questions  revolve  around  (l)  the 
amount  of  information  it  is  possible  to  absorb,  integrate,  and  weight 
effectively;  (2)  the  display  densities,  format,  and  colors  that  may  be 
best  for  presentation  of  the  information;  (5)  the  most  appropriate 
combinations  of  specific  information  and  general  information  to  be  in¬ 
cluded  in  alpha-numeric  and  symbolic  displays  (maps  and  overlays),  and 
(4)  the  relative  effectiveness  of  alpha-numeric  and  symbolic  displays 
for  different  classes  of  information. 

The  input  function  is  directly  affected  by  the  resolution  of  problems 
in  the  information  assimilation  and  decision  making  areas.  For  example, 
conclusions  concerning  amount,  density,  and  combinations  of  specificity- 
generality  of  information  to  be  presented  to  the  commander  and  his  staff 
will  affect  the  load  and  demands  on  the  input  operators.  Findings  on  the 
general  effectiveness  of  alpha-numeric  and  symbolic  displays  may  conflict 
with  the  efficiency  with  which  information  can  be  input  through  the  corre¬ 
sponding  input  devices.  While  symbolic  representation  may  be  more  useful 
in  the  decision  making  process,  input  of  symbolic  information  may  prove 
to  be  very  costly  in  terms  of  time  and  accuracy,  especially  when  different 
scales  have  to  be  used. 
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Additional  considerations  must  be  faced  when  the  implications  of 
these  questions  are  traced  back  to  the  transforming  operation  that  pre¬ 
cedes  information  input.  Findings  can  be  expected  to  influence  the 
amount  of  transforming  that  will  have  to  be  done,  the  proportions  of 
transforming  of  different  kinds  (plain  language  to  plain  language,  plain 
language  to  symbols),  and  the  method  of  transforming  (simple  annotations 
such  as  underlining  and  circling  versus  highly  formalized  formats  and 
templates) . 

In  the  information  screening  function,  factors  such  as  load,  number 
and  types  of  sorting  classes,  routing,  and  the  configuration  of  individ¬ 
uals  for  the  effective  handling  of  large  masses  of  varied  raw  data  emerge 
from,  and  must  be  amalgamated  with,  all  of  the  questions  discussed  above. 


DYNAMIC  ASPECTS  OF  INFORMATION  DISPLAYED 

A  second  category  of  questions  is  concerned  with  the  dynamic  or 
changing  aspects  of  the  information  presented  or  displayed.  What  com¬ 
binations  of  rate  of  information  updating  and  degree  of  change  in  an 
update  are  optimum  for  assuring  the  conspicuity  of  change  that  has 
occurred?  What  is  the  utility  of  hard  copy  to  the  commander  and  his 
staff  for  pointing  up  trends  and  providing  a  sense  of  "history",  for  en¬ 
hancing  feedback  of  information  through  comparison  of  current  information 
with  hard  copy  of  past  information,  and  for  manual  backup  and  alternate 
TOC  purposes?  Where  information  is  available  at  a  number  of  levels  of 
specificity-generality  and  in  the  form  of  a  number  of  different  scales, 
are  certain  sequences  of  viewing  this  information  better  than  others? 


DISPLAY  MODES 

A  third  cluster  of  questions  addresses  itself  primarily  to  other 
formal  or  structural  aspects  of  information  display  and  presentation. 

What  display  or  sensory  modalities  are  best  for  information  assimilation 
and  decision  making  purposes?  Are  there  some  combinations  of  sensory- 
modalities  that  would  enhance  performance?  '•■That  are  the  relative  merits 
of  group  versus  individual  displays?  Are  both  kinds  necessary  and  if  so, 
how  many  of  each? 


CERTITUDE,  PROBABILITY,  AND  CREDIBILITY 

A  fourth  category  of  problems  concerns  credibility  of  information 
presented  and  certitude  on  the  part  of  the  decision  maker.  Is  certitude 
a  necessary  condition  for  good  performance  over  time?  What  is  the  rela¬ 
tionship  between  certitude  and  performance?  If  certitude  is  an  important 
factor  in  performance,  can  certitude  be  enhanced  through  manipulation  of 
display  characteristics?  To  what  extent  is  it  necessary  or  desirable  to 
present  to  the  commander  and  his  staff  qualitative  statements  as  to  credi¬ 
bility  of  the  information  and  quantitative  estimates  of  its  probability? 


RESEARCH  APPROACHES 


The  series  of  studies  that  make  up  the  research  program--in  progress 
or  projected- -have  been  planned  to  yield  basic  human  factors  information 
on  the  five  critical  functions  in  information  processing.  Most  of  the 
research  effort  for  the  next  fev  years  is  expected  to  concentrate  on  the 
functions  of  information  assimilation  and  decision  making  from  displays — 
unless,  of  course,  circumstances  and  resources  indicate  a  shift  in 
emphasis  or  broader  effort. 


STUDIES  ON  DECISION  MAKING  AND  INFORMATION  ASSIMILATION  FUNCTIONS 

In  most  of  the  planned  series,  parallel  studies  will  be  conducted 
with  alpha-numeric  and  symbolic  displays.  The  criterion  or  performance 
measures  will  consist  of  one  or  more  measures  of  accuracy,  appropriate¬ 
ness,  time,  and  certitude.  The  studies  will  incorporate  substantive, 
quantitative,  qualitative,  formal,  and  conceptual  aspects  of  information 
and  will  sample  problem  solving  situations  of  different  complexity 
levels,  and  situations  ranging  from  relatively  slow  to  relatively  rapid 
changes  of  events. 

Amount  and  Density  of  Information.  The  first  series  of  studies  will 
have  as  their  main  variables  the  total  amount  of  information  presented  on 
a  single  slide  to  a  commander  and  his  staff,  and  the  density  of  this 
information.  Different  amounts  and  densities  of  information  will  be  pre¬ 
sented  to  individuals  and  various  aspects  of  their  responses  (performance 
measures)  to  questions  about  the  information  will  be  recorded  and  analyzed. 
An  example  follows: 

Military  information  in  the  form  of  a  Friendly  Tactical  Units  Status 
Tote  (Figure  5)  is  projected  on  a  screen  to  the  examinees.  The  informa¬ 
tion  is  arranged  in  10  columns,  10,  l8,  and  25  rows,  and  three  different 
densities  or  spacings.  Questions  of  three  different  levels  of  complexity 
are  asked;  alternative  answers  are  distributed  over  five  different 
positions.  Accuracy  of  answers  and  time  taken  to  answer  will  be  analyzed 
as  a  function  of  the  experimental  variables. 

Format  and  Color  Coding.  This  series  of  studies  will  deal  primarily 
with  variations  in  display  format  and  the  use  of  color  for  coding  and 
transmitting  information.  Various  display  formats,  colors,  and  color 
combinations  will  be  manipulated  in  order  to  ascertain  the  effects  on 
apprehension  and  use  of  given  information.  Some  studies  will  deal  with 
horizontal-vertical,  circular,  matrix,  and  polar- coordinate  types  of 
format.  In  addition,  simple  annotation  of  information  presented  in 
narrative  form  will  be  tested  against  more  elaborate  and  less  flexible 
format. 
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Figure  Friendly  Tactieau  Units  Status  Tote 


Specificity-Generality  of  Information.  A  particularly  important 
problem  in  need,  of  resolution  is  the  degree  and  combination  of  verbal 
information  detail  and  particularization  and  map  and  overlay  scales  which 
are  most  effective  in  information  processing  and  display  systems.  One 
study  is  planned  in  which  three  map  and  overlay  scales  and  three  levels 
of  detail  (battalion,  regiment,  and  division,  for  example)  will  be  used 
to  present  a  military  situation.  Questions  of  different  complexity  and 
scope  will  be  asked  of  the  examinees.  Accuracy  of  answers,  "appropriate¬ 
ness"  of  decisions,  time  taken  to  respond,  certitude,  and  frequency  and 
sequence  of  viewing  the  different  scales  and  levels  of  detail  will  be 
analyzed  in  terms  of  the  complexity  of  questions  asked. 

Alpha-numeric  and  Symbolic  Presentation.  Considering  the  mass  of 
information  involved  in  large  scale  military  operations,  considerable 
benefit  could  derive  from  knowledge  about  the  relative  merit  of  present¬ 
ing  different  classes  of  information  alpha-numerically  and  symbolically. 
Studies  in  this  series  will  seek  to  determine  the  relative  effectiveness 
with  which  experimentally  controlled  information  depicted  in  the  two 
different  ways  is  handled.  Trade-off  and  compromise  may  be  necessary, 
however,  if  findings  in  the  area  of  decision  making  and  information 
assimilation  are  at  great  odds  with  those  in  the  input  and  other  human 
information  processing  areas. 

Type  and  Extent  of  Information  Change.  In  changing  situations,  in 
addition  to  quantitative  and  formal  aspects  of  the  total  context  of  infor¬ 
mation,  the  extent  and  type  of  "tolerable"  information  change  are  important 
factors.  In  an  updated  slide,  for  example,  elements  of  information  may 
have  been  removed,  added,  or  re-positioned.  What  procedures  will  enhance 
the  commander's  awareness  of  significant  changes,  however  small? 

In  one  study,  16  pairs  of  slides  were  projected  on  a  group  display 
to  each  of  eight  groups  of  four  examinees.  Each  pair  consisted  of  a 
reference  slide  which  contained  12,  1 6,  20,  or  2k  military  symbols 
(Figure  6)  and  a  test  slide  from  which  2,  k,  6,  or  8  of  the  original 
symbols  had  been  removed.  The  examinees  were  asked  to  indicate  which 
symbols  had  been  removed  and  their  certitude  regarding  the  correctness 
of  their  answer.  Data  from  this  study  are  being  analyzed  to  ascertain 
the  relationships  among  total  amount  of  information  presented,  number  of 
elements  removed,  accuracy  of  performance,  and  certitude  of  performance. 

The  findings  will  furnish  information  on  the  process  of  map  and  overlay 
viewing. 

Rate  of  Information  Change.  A  closely  related  area  which,  however, 
merits  attention  in  its  own  right  concerns  the  pitting  of  rate  of  infor¬ 
mation  updating  or  change  against  the  type  and  extent  of  change  mentioned 
above.  Obviously,  some  balance  or  flexible  arrangement  will  have  to  be 
struck  among  these  factors.  Studies  are  planned  to  simulate  slow  and 
fast  moving  conditions,  various  rates  of  updating,  and  different  amounts 
and  types  of  information  change  to  ascertain  the  interaction  of  these 
factors  and  their  effects  on  performance.  Findings  will  have  procedural 
implications  for  systems  use. 
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Figure  6.  Reference  slide  for  study  of  type  and  amount  of  change  in 
information  presented. 


Hard  Copy.  Some  information  processing  systems  are  planned  in  which 
much  of  the  information  is  highly  transient  and  almost  everything  except 
current  information  is  "dumped"  out  of  the  system.  The  utility  of  hard 
copy,  alone  and  in  conjunction  with  "fleeting"  information,  deserves  con¬ 
siderable  attention.  The  contribution  of  hard  copy  toward  providing  a 
better  sense  of  continuity  and  trend  and  for  enhancing  information  feed¬ 
back  is  self-evident.  However,  does  hard  copy  in  fact  contribute  toward 
a  better  base  from  which  to  make  appropriate  and  timely  decisions?  Or 
is  the  cost  and  time  involved  in  the  production,  storage,  retrieval,  and 
perusal  of  hard  copy  inordinate  with  respect  to  possible  gains? 

Sequence  of  Information  Receipt.  Automated  information  processing 
systems  include  different  levels  of  information  detail  and  map  and  over¬ 
lay  scales.  Individuals  will  vary  in  the  order  in  which  they  go  through 
these  different  levels  and  scales  in  the  solution  of  problems.  Examples 
from  research  testify  to  the  inadequacy  of  work  methods  arrived  at  through 
"natural  inclination".  A  series  of  studies  will  be  conducted  wherein  ex¬ 
perimental  sequences  developed  for  problems  of  different  complexity  will 
be  tested  against  sequences  preferred  by  individuals  and  groups. 
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Individual  and  Group  Displays.  When  a  group  of  individuals,  each 
with  different  major  responsibilities,  are  jointly  involved  in  the  solu¬ 
tion  of  complex  problems,  can  they  work  more  effectively  with  a  large 
group  display  or  individual  smaller  display  consoles,  or  some  combination 
of  these?  One  large  display  may  enhance  communication  among  the  individ¬ 
uals  viewing  it.  However,  a  number  of  smaller  individual  displays  adds 
flexibility,  in  that  all  specialists  can  view  independently  and  simulta¬ 
neously  those  information  facets  most  relevant  to  their  special  interest. 
After  such  viewing  and  consideration  of  information,  1  responsible  in¬ 
dividuals  can  then  gather  to  view  the  large  display  and  take  advantage  of 
rapid  and  personal  interaction  and  communication  to  resolve  the  issues 
before  them.  Studies  in  this  area  will  seek  to  test  the  validity  and 
utility  of  these  various  procedures.  The  relative  effectiveness  of 
group,  individual,  and  combined  group  and  individual  displays  will  be 
evaluated  in  a  number  of  problem  solving  situations. 

Visual  and  Auditory  Displays.  Only  the  visual  and  auditory  media 
are  used  for  information  transfer  in  automated  information  processing 
systems.  Because  of  certain  limitations  of  the  auditory  sense— fewer 
dimensions  for  coding,  attention  demands,  sequential  arrival  of  informa¬ 
tion,  rate  of  information  transmission  limited  to  speaking  rate — more  and 
more  emphasis  appears  to  have  been  placed  on  visual  displays.  It  seems 
reasonable  to  question  whether  visual  channels  are  overloaded,  and  whether 
auditory  channels  are  being  sufficiently  exploited.  What  might  be  the 
optimal  allocation  of  information  transmission  load  to  visual  end  auditory 
media?  Some  of  the  very  limitations  of  the  auditory  sense  can  possibly 
be  exploited.  If  the  information  is  simple,  if  there  are  frequent  end 
prolonged  periods  of  quiescence,  if  same  classes  of  information  are 
better  assimilated  and  utilized  when  presented  in  a  particular  sequence, 
auditory  media  might  be  preferable.  Examples  of  studies  in  this  area 
are  a  comparison  of  the  merits  of  the  two  media  for  various  classes  of 
information,  and  the  effect  of  differing  allocations  of  information  trans¬ 
mission  load  to  sensory  media.  In  addition,  the  simultaneous  presenta¬ 
tion  of  visual  and  auditory  stimuli  for  purposes  of  information  conspi- 
cuity,  emphasis,  and  the  like,  will  be  investigated. 

Certitude,  Probability,  and  Credibility.  The  interrelationships  of 
the  nature  of  information  presented,  subjective  feeling  of  confidence, 
and  actual,  performance  have  implications  bearing  on  (l)  enhancement  of 
performance  and  confidence  by  providing  probability  and  credibility  in¬ 
formation;  and  (2)  the  possible  use  of  relatively  easily  obtained 
certitude  scores  as  intermediate  criterion  measures.  The  following 
exemplifies  the  studies  envisaged: 

Military  situations  and  information  will  be  depicted  with  and  with¬ 
out  accompanying  data  on  credibility  or  sources  of  information  (enemy, 
prisoner,  photograph)  and/or  probability  or  validity  of  the  information 
(P  =  .7  that  the  enemy  missile  is  being  readied  to  fire).  Further,  the 
statements  of  credibility  and  probability  will  be  varied.  Problems  and 
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questions  of  varied  complexity  will  be  presented  to  the  examinees.  Again, 
accuracy,  appropriateness,  speed,  and  certitude  of  information  assimila¬ 
tion  and  decision  making  will  be  measured.  The  data  will  be  analyzed  to 
ascertain  the  relationships  among  information,  certitude,  and  performance 
variables.  Also,  the  impact  of  these  additional  data  on  other  information 
display  characteristics  will  be  investigated.  For  example,  it  is  not 
known  whether  credibility  and  probability  data  over  and  above  normal 
military  information  constitute  an  additional  burden  and  result  in  decre¬ 
ment  in  performance,  or  whether  the  additional  data  will  assist  the  re¬ 
cipient  in  wading  through  larger  amounts  of  information. 


Certitude  Measurement.  Several  experiments  have  been  outlined  con¬ 
cerning  appropriate  methodology  for  eliciting  and  quantifying  judgments 
of  certitude.  In  an  initial  study  dealing  with  type  and  extent  of  infor¬ 
mation  change,  findings  from  research  on  interval  scales  for  measuring 
subjective  judgments  in  areas  other  than  certitude  were  adapted  to  a 
certitude  measurement  continuum.  Individuals  participating  in  the  study 
indicated  the  degree  of  certainty  they  felt  about  their  accuracy  in 
assimilating  information,  using  a  rating  scale  containing  eight  cate¬ 
gories — balanced  positive  and  negative  with  no  neutral  position  and  each 
category  verbally  anchored  (Figure  6).  The  results  are  being  analyzed 
in  terms  of  characteristics  of  the  continuum  as  determined  by  successive 
interval  scaling  techniques.  Interval  widths,  scale  values  of  the  inter¬ 
vals,  reproducibility,  and  response  information  transmitted,  and  the  like, 
will  be  evaluated  in  terms  of  the  model  used  and  in  relation  to  typical 
findings  for  such  scales  in  other  areas. 

In  another  study  (see  discussion  of  historical  tie-back  below)  an 
attempt  is  being  made  to  ascertain  whether  the  nature  of  the  symbols  dis¬ 
played  has  an  appreciable  effect  on  the  pertinence  and  precision  of  cer¬ 
titude  measures  used  in  span  of  apprehension  studies  reported  in  the 
literature.  Here,  the  nature  of  the  scale  and  tachistoscopic  exposure 
times  were  selected  to  duplicate  those  commonly  reported  in  the  litera¬ 
ture.  A  scale  analysis  of  the  type  described  above  should  provide  infor¬ 
mation  not  presently  available  in  the  literature  about  the  underlying 
certitude  continuum;  and  perhaps,  by  comparison  with  the  results  of  the 
analysis  of  the  eight- category  scale,  such  studies  will  provide  some 
gross  indication  of  the  relative  suitability  of  scale  types. 

Depending  on  the  results  of  these  studies  and  the  insights  they 
provide  regarding  the  nature  of  certitude  judgments  and  their  measurement, 
either  minor  modifications  and  refinements  will  be  made  and  empirically 
tested,  or  a  major  project  will  be  undertaken  to  develop  a  precise, 
quantitative,  and  meaningful  methodology  of  certitude  measurement. 

Historical  Tie -Back.  Most  of  the  studies  planned  will  allow  for 
visual  presentation  of  information  for  "sufficient"  or  necessary  dura¬ 
tion.  Tachistoscopic  (brief  exposure  time)  studies  will  also  be  con¬ 
ducted  to  ascertain  whether  the  variables  and  phenomena  dealt  with  in 
the  present  research  program  behave  in  the  same  way  as  those  that  have 
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been  investigated  in  a  large  number  of  tachistoscopic  studies.  If  con¬ 
siderable  correspondence  is  found  between  the  results  of  command  systems 
studies  and  those  that  have  been  done  in  the  past,  the  current  research 
program  may  be  able  to  capitalize  on  what  has  already  been  done  and  reduce 
the  number  of  planned  studies  and  the  time  allotted  to  experimentation. 

One  study  accomplished  by  USAPRO  concerned  span  of  apprehension  and 
certitude.  Nine  different  amounts  of  military  symbols  (4,  5,  6,  7,  8, 

10,  14,  18,  and  22)  were  presented  for  .5  and  .2  seconds  to  each  of  eigdit 
groups  of  four  examinees.  Estimates  of  the  number  of  symbols  presented 
and  certitude  ratings  on  a  five-point  scale,  anchored  on  both  ends  with 
adjectives,  were  collected.  Data  are  being  analyzed  to  ascertain  the  re¬ 
lationships  among  number  of  symbols  presented,  exposure  time,  estimates 
of  symbols  presented,  and  certitude  ratings. 


PLANNED  RESEARCH  ON  INFORMATION  PREPARATION 

Inasmuch  as  the  USAPRO  effort  for  the  next  few  years  will  be  concen¬ 
trated  on  the  functions  of  decision  making  and  information  assimilation 
from  displays,  the  present  research  study  deeds  only  briefly  with  the 
screening,  transforming,  and  input  functions  of  the  TOC.  A  more  compre¬ 
hensive  and  articulated  statement  of  planned  research  on  the  information 
preparation  functions  will  be  prepared  prior  to  implementation  of  research 
on  those  functions. 

The  experimental  variables  to  be  dealt  with  in  research  on  the  infor¬ 
mation  preparation  functions  will  tend  to  duplicate  those  investigated  in 
the  studies  just  outlined.  The  primary  purpose  will  be  to  ascertain 
whether  the  findings  concerning  human  performance  in  decision  making  and 
information  assimilation  are  compatible  with  the  speed  and  accuracy  of 
human  operations  required  in  information  preparation.  The  probable  im¬ 
pact  of  research  findings  in  decision  making  and  information  assimilation 
on  load,  speed,  and  accuracy  of  information  preparation  can  best  be  seen 
in  the  context  .of  the  studies  dealing  with  information  specificity- 
generality,  alpha-numeric  and  symbolic  presentation  of  information,  cer¬ 
titude,  credibility,  and  probability  in  decision  making,  and  type,  extent, 
and  rate  of  information  updating.  Findings  in  those  areas  can  be  expected 
to  have  an  impact  on  information  processing  functions  with  respect  to 
number,  type,  and  rate  of  separate  inputs,  and  the  transformation,  screen¬ 
ing,  and  sorting  categories  required.  Not  so  apparent — but  of  critical 
importance — is  the  effect  of  these  variables  on  speed  and  accuracy  of 
performance  of  input,  transforming,  and  screening  functions. 

If  findings  are  consistent  across  human  functional  areas,  the  number 
of  problems  involving  trade-off  will  be  reduced.  If,  however,  there  are 
practical  and  frequent  discrepancies,  the  implications  are  as  follows: 

(l)  need  to  develop  special  work  methods  and  trade-offs  across  the  five 
critical  operations  in  current  and  imminent  systems  and  (2)  need  for 
radical  re-conceptualization  of  the  design  of  systems,  to  include  modified 
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allocation  of  functions  to  man  and  equipment  and  the  development  of  new 
equipment  and  devices.  A  certain  amount  of  re-conceptualization  and  re¬ 
design  will  occur  through  "natural"  technological  evolution.  For  example, 
more  direct  input  or  transfer  of  information  to  computers  and  storage 
devices  through  data  links  may  eliminate  scane  of  the  input,  transforming, 
and  screening  functions  now  performed  by  men. 


FACILITIES  FOR  LABORATORY  SIMULATION 

In  order  to  carry  out  the  program  of  research  outlined,  some  simula¬ 
tion  of  command  information  processing  systems  will  be  necessary.  Approxi¬ 
mately  2000  square  feet  of  laboratory  space  has  been  allocated  to  the  task 
for  this  experimentation.  The  following  laboratory  equipment  is  being 
acquired: 

Visual  Equipment.  Two  random  access  slide  projectors,  individual 
and  group  rear  view  projection  screens,  a  tachistoscope,  memory  drum 
apparatus,  photo  relays,  and  an  illuminometer. 

Auditory  Equipment.  Tape  recorders,  a  speech  and  white  noise 
generator,  speakers,  individual  headsets,  microphones,  and  a  decibel 
meter. 

Complementary  Equipment .  DC  power  supply,  a  repeat  cycle  timer, 
micro  switch  boxes,  and  voice  keys  and  relays. 

Recording  Equipment.  A  sound  motion  picture  camera,  one  way  viewing 
glass,  time  and  event  recorders,  and  electronic  counters. 

In  the  future,  alpha-numeric  and  symbol  input  devices,  computer 
facilities,  rapid  slide  generating  equipment,  communications  equipment 
(radio,  teletype)  will  be  needed.  An  additional  1000  square  feet  of 
space  will  be  required  to  house  the  added  equipment. 


NEW  DEVELOPMENTS 

Finally,  some  effort  will  be  expended  in  keeping  abreast  of  new  de¬ 
velopments  and  future  command  information  processing  systems.  The  purpose 
is  to  avoid  the  obvious  shortcomings  of  being  bound  to  a  particular  gener¬ 
ation  of  systems,  to  maintain  a  responsiveness  to  new  needs  through  a 
flexible  research  program  oriented  toward  providing  findings  with  broad 
application.  This  effort  will  be  carried  out  by  continuing  participation 
in  research  and  development  programs  in  the  Army  and  other  agencies  such 
as  the  AN/M3Q-19  (ARTOC)  program  and  the  Visual  Displays  Working  Group  of 
the  National  Research  Council  Vision  Committee,  and  attendance  at  infor¬ 
mation  systems  conferences  and  symposia. 
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